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Abstract 

We compute the Bray and Moore (BM) TAP Complexity for the Sherrington-Kirkpatrick model 
through the cavity method, showing that some essential modifications are needed with respect to the 
standard formulation of the method. This allows to understand various features recently discovered 
and to unveil at last the physical meaning of the parameters of the BM theory. We also reconsider the 
supersymmetric (SUSY) formulation of the problem finding that the BM solution satisfies some proper 
SUSY Ward identities that are difi'erent from the standard ones. The SUSY relationships encode the 
physical meaning of the parameters obtained through the cavity method. The problem of the vanishing 
prefactor is addressed showing how it can be avoided. 

1 Introduction 

The cavity method was introduced nearly twenty years ago in Ref. |3] in order to recover the Parisi solution 
of the Sherrington-Kirkpatrick (SK) spin-glass model without the rephca method and starting explicitly 
from the hypotheses encoded in his replica-symmetry breaking (RSB) ansatz jlj. In the last years this 
method has proven to be a powerful tool to investigate disordered systems with tree-like structure and 
optimization problems (see 01 El El 3.nd references therein) . In particular it has been possible to obtain 
a non-perturbative equilibrium solution of the Spin-Glass on the Bethe lattices at the IRSB level 0}. The 
method has been also used to compute the complexity i.e. the logarithm of the number of metastable 
states with free energy higher than the equilibrium one jS] . It is natural to expect that in the limit of high 
connectivity this model should become identical to the SK model and the corresponding complexity curve 
should be equal to the number of stable solutions of the Thouless- Anderson-Palmer (TAP) equations 
However the resulting complexity turns out to be different from the TAP complexity computed more than 
twenty years ago by Bray and Moore (BM) in [21 and instead to be equal to another complexity curve 
yielded by the so-called supersymmetric (SUSY) solution (HI El El El- This has motivated a renewed 
interest IllL I12L E| in the problem of the TAP Complexity starting from the observation that the BM 
solution violates a supersymmetry (SUSY) jl4[ 1151 [T6t .17, as first noted in ^21- Furthermore after the 
observation J31 that the SUSY solution is unstable in the SK model (except at the lower band edge) both 
at the annealed and at the quenched level, the BM solutions has remained the unique candidate to describe 
the TAP complexity and it has becomes mandatory to solve the problems posed by the SUSY violation; 
as we will bricfiy report in the following some important results in this direction have been obtained in 
[T^ and rigorously confirmed in In this paper we will address the problem of the formulation of the 
BM solution within the cavity method obtaining as a byproduct to clarify various issues connected to the 
SUSY violation and to eventually obtain the physical meaning of the parameters A and A of the theory. 

Within the BM computation 2 the TAP complexity is expressed as an integral over a certain action 
that can be evaluated by the saddle point method in the thermodynamic limit. Their solution yields a 
bell-shaped complexity curve S(/) describing solutions of the TAP equations with a given free energy. This 
action posses a SUSY that is violated by the BM solution |^ . We refer the reader to Ref. [181 IIUI El 
for the discussion of the SUSY of the problem and in particular to [201 whose notation will be adopted in 
the discussion of section 13 This somehow exotic symmetry is related to important physical features of the 
problem. The first is the Morse theorem that states that the number of solutions of the TAP equations 
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with positive Hessian {e.g. minima) minus the number of solutions with negative Hessian (the saddles) is 
a topological invariant equal to one. It is the generalization of the one dimensional result that is easily 
understood. In particular if we find an exponential number of minima we must find also an exponential 
number of saddles. Before the investigations of the last months it was believed that the BM solution 
described minima of the TAP free energy, therefore an unavoidable question was: were are the saddles? 
Furthermore given that those supposed minima of the TAP free energy had a positive definite Hessian it 
should be possible to continue each one of them upon continuously changing the external parameters of 
the TAP equations such as temperature or magnetic field and also upon adding a spin to the system of A'^ 
spins. The possibility of continuing the solutions poses two problems. The first problem, noted in |12j, is 
that starting from the hypothesis that the TAP solutions can be continued one can obtain some relations 
that are identical to the Ward identities yielded by the SUSY of the problem; thus there is a contradiction 
between the possibility of continuing the TAP solutions and the fact the BM solution describing them is 
not SUSY and does not satisfy the corresponding Ward identities. The second problem is that since the 
solutions can be continued upon changing the external parameters they cannot disappear, therefore their 
number must remain the same at all temperatures and magnetic fields, but this is in contradiction with 
the fact that the BM complexity varies with temperature and field. On the other hand if the complexity 
changes with the temperature and the magnetic field the relevant exponential number of solutions at given 
values of the external parameters must disappear upon a small change of them and therefore the Hessian 
of these solutions must have at least a zero eigenvalue. 

These problems of the BM solution have been solved reconsidering the TAP spectrum. In it was 
pointed out that the spectrum contains an isolated eigenvalue besides the continuous positive band and it 
was checked numerically that this eigenvalue vanishes on the TAP solutions described by the BM solution, 
this result has been proven rigorously in |20| and it is precisely a consequence of the SUSY violation. 
Following and (201 we recall that the appearance of the isolated eigenvalue is connected to the fact 
that the Hessian can be written in the form A = B + P where P is a projector. Given two symmetric 
matrices A and B that differ by a projector P — \a){Q:\ we have: 

A = B + P — > det A = (1 + V>) det B , (1) 

that is the determinant of the total Hessian A is the product of the determinant of B times a factor 
depending on B and on the projection vector. The matrix B is essentially the matrix of the interactions 
and it can be studied through standard random matrix theory [21 1121 UHl ■ It turns out to have always 
a positive spectrum with a continuous band of eigenvalues whose lower band edge extends down to zero if 
the following quantity is zero: 

Xp = l-/32^(l-m2)2 

i 

The quantity Xp however is different from zero on the BM solution, although it vanishes at the lower band 
edge in the quenched case where it coincides with the Parisi solution |25[I12| . The inclusion of the projection 
term modify the eigenvalues of B, however the — 1 higher eigenvalues remain confined in the original 
band i.e. they remain positive, only the lowest eigenvalue is split out of the band of a finite amount possibly 
becoming negative. Therefore the TAP solutions can only be minima or saddles of order one depending 
on the sign of the isolated eigenvalue or equivalcntly of the factor (1 + {a\B^^\a)), if this term is zero the 
isolated eigenvalue vanishes and the solution is an inflection point. Starting from equation ^ applied to 
B = A — P it is easy to prove that the factor controlling the determinant of the Hessian can be also written 
as: 

l + {a\B-'\a)= I (2) 

1 — {a\A '-\a) 

Thus we can express the factor controlling the determinant of the Hessian A in term of the susceptibility 
matrix X = A^^ , and the key object controlling the sign of the isolated eigenvalue is the quantity L defined 
as: ^ 

In [201 it is proven that this quantity is divergent on the BM solution because of the SUSY violation 
therefore the isolated eigenvalue is zero. On the numerical ground the situation is not completely clear 
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|26[ 177] although some evidences in favor of the BM solution and of its predictions have recently exhibited 
in |27| . Furthermore an argument can be advanced for the continuity of the TAP Complexity at T = 
[2H| J a property that is satisfied by the BM solution. 

The study of the isolated eigenvalue however have not solved all the problems connected to the BM 
solutions. For instance it is not clear why the whole curve is dominated by solutions with a zero 

eigenvalue and not only the point where it is maximal [201 • It is also known ^21 that the prefactor of the 
exponential contribution to the total complexity vanishes at all orders in power of a result that was 
extended to the whole curve in [20]. As discussed in JS] and J^O] this may be a good thing to recover 
the Morse theorem prediction but leaves open the question of wether we can really identify the complexity 
with the exponential contribution if its prefactor is zero. 

Most importantly the presence of a zero eigenvalue complicates the behavior of the TAP solutions upon 
changing the external parameters, and in particular the possibility or not of continuing them, a property 
that is crucial to set up the Cavity method in order to apply the theory to a wider class of problems. In the 
following we will answer to these questions, as a byproduct we will eventually obtain the physical meaning 
of the parameters A and A of the BM theory that have remained obscure up to now. 

In order to understand the whole features of the BM solution for the TAP complexity we must consider 
two order parameters, the free energy / and the self-overlap q and not only /. Thus we must study the 
function E(/, q) or equivalently the function E(m, Xq) defined as 

S(/,g)-ln^<5(<Z-q„„)^(/-/„) ; A,) = In^ e-"/°-^«9°° (4) 

a a 

The extremization with respect to q and /, in order to compute the total complexity, requires to set u = 
and Xq = in the computation of E, however we will show that we cannot set Xq = from the beginning 
but we must study the Xq ^ case and take the limit, indeed Xq appears in products with quantities that 
are divergent in the limit Xq —^ thus yielding a finite contribution. One of these diverging quantities is 
precisely the parameter L introduced above whose inverse controls the sign of the isolated eigenvalue. On 
the contrary there are no divergences associated to the parameter u that can be safely set to zero from 
the beginning. Furthermore the singular behavior associated to the limit Ag — > is present for each u thus 
explaining why the whole line E(/) of the BM solution is singular and the prefactor of the exponential 
is zero. In the following we will consider only the case u — and we will study the curve E((j') or its 
Legendre transform E(Ag). We recall that in the thermodynamic limit the two formulations are completely 
equivalent because the function E(Aq) defined above is dominated by the solution at a given value of q that 
fixes a univoque correspondence between Xq and q , the two functions are indeed Legendre transforms one 
of the other: 

dE dE 

''=-dX-q'^ 

S = S - Agg (6) 

We will find that the isolated eigenvalue is proportional to A^ thus the determinant of the Hessian of the 
TAP solution is zero at A, = as already shown in ^0] and but it is finite for Xq ^ 0. Considering eq. 
(J^l we see that the point q* where the curve E(g) is maximal separate two regions: on one side we have 
the minima while on the other side we have the saddles of order one, the two regions touch at q = q* that 
corresponds to solutions that are inflection points in the TAP landscape. 

As soon as Xq ^ the corresponding TAP solutions have a non-vanishing determinant of the Hessian 
thus it is possible to continue them upon changes of the external fields, e.g. temperature and magnetic 
field. In particular we will be able to apply the cavity method studying the continuation of each TAP 
solution when a new spin is added. The use of the cavity method to compute the complexity is discussed in 
the literature, see e.g. JS] and |13j . the crucial modification presented in the next section is that to recover 
the BM prediction for TAP complexity we need to weight the states with the overlap rather than with the 
free energy. 

In section 12] we will discuss the A, 7^ case within the SUSY context, this will allow to clarify many 
points, from the behavior of the prefactor to the meaning of the SUSY Ward identities. We will find that the 
BM solution do satisfy the SUSY Ward identities at each A,, however because of the afore cited divergences 
in the limit Xq ^ these Ward identities are different from those obtained setting simply A, = {e.g. the 
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one considered up to now in the literature see e.g. |18[llUl[T2] ). in other words if we carefully take the limit 
Xq Q we find that the non-SUSY solution satisfies the correct SUSY identities. 

Before entering the computation of the TAP complexity within the cavity method we recall what are 
the modifications that must be made to study the A, ^ case in the standard BM computation of Ref. 
P]. To compute the function S(A^) we must simply add to the expression (15) of |2] a term equal XgQ and 
then extremize at fixed with respect to the parameters q, B, A and A (not to be confused with A^). 
The resulting equation for B, A and A are the same as in the Xq — case while the equation obtained 
extremizing with respect to q is 

A.^-A + A.B-l(l- «'""";;-^'"°)'' ) (7) 

Consistently upon computing the complexity one finds that Xq and q satisfy the relations 

2 Cavity method for the TAP Complexity 

2.1 The Continuation of a TAP solution when a new spin is added 

The TAP equations of the system with N spins read: 

- + ^ ^(1 - TO^)mi + tanh"^ = (8) 

We add a new spin mo to the system and make the following definitions: 

m^^^^'' — nii + SrUi (9) 
Aq = Q(^+i) - Q(^) ^ml + 2j2 + J2 (1°) 

i 

R{5m.) = tanh-i - tanh-^ - JT^'^^"* = \ (d^T^) + ^ (]^) 

-§ - "ij) j - -hj - '^mruj (12) 

We also define two fields and three parameters for later use: 

Hi = '^Jjoruj (13) 

j 

H2 - ^J,o(5]X,,m,) (14) 

L = ^^m^XiJmj (15) 

Zi = ^^m^{X'^)^JmJ (16) 

- y (x„m,) ( — — y xi (17) 




N 



= ^Y.(^')3J (18) 



N 
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We adopt the convention that aU the objects without the label {N + 1) are computed on the N system. 
From the TAP equations in presence of the spin ttiq we can derive an exact expression for dnii in implicit 
form: 



Smi = '^Xij i Jjoruo - -^(1 - ml)mj + ^'^Smj.mj ~ ^(1 - /^q)5mj - -^R{6mj) ] (19) 
From the previous expression we have: 

6m, = J2 Joomo + O (^) (20) 

i ^ ^ 

Therefore 

^ E = ^^TrXVg ^ ml^XsG + ... (21) 

Using this relation we can easily obtain from the exact expression (|19|l an expression for Snii in explicit 
form valid to order 1/A^: 

6m, ^Jjomo - ^(1 - ml)m, + ml^Xsam, - ^ (^J^^) (E^-^-^-o) j +^ {j^ 

(22) 



2.2 The expression for mo at order 0(1) and the susceptibihties 

The equation for mo at order 0(1) is: 

tanh-^ mo + /3^(1 - g)mo - /? ^ J^om,^^+^^ = (23) 

i 

the field h[^^^^ can be expressed in term of the field Hi: 

h[^+^^ =Hi+Y, J^^^m^ = Hi+Y. J^oX^JJJomo + O (^) =Hi+ mo^TrX + O (24) 



N N \N 

Introducing the variable B: 

B = I3\l - q) - ^TrX , (25) 
we can express mo in terms of the field Hi computed on the system with N spins: 

tanh"^ mo + Brno - (iHi = . (26) 
In presence of a magnetic field acting on the spin mo we have 

tanh"^ mo + Bmo - l3Hi ~ pho = , (27) 
and we can obtain the following susceptibilities at order 0(1): 

5^^^Xo„ = /3(-^ + 5)" + ... (28) 
(Pmo d ( dho\^^ dmo f d 1 \ / 1 dm^ 

P — 172 + ^ -n- + ■ ■ ■ (29) 



d/iQ dmo \ dmo / dh^ \ dmo 1 — m^ J V 1 ~ "^o / "^^o 

The mixed susceptibility can be obtained from the explicit expression of 6mi valid at order O ( 1 /N) , equation 

= 'tl^ = (30) 



= f J.o^oo + ^moXoomj + 2moXoo^XsGm, - "I^^^ {^ dm^ \ - m^ (^^sjJs^^j j +0 



( 1 



(31) 
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2.3 The Self-Overlap shift 

The shift of the self-overlap reads: 

Aq = Q(^+i) ~ Q(^) = + 2 ^ m,Sm, + ^ Sm^^ (32) 

i 

The term rriiSmi can be evaluated at order 0(1) starting from the expression for 5mi at order 0(l/iV), 
equation H22|) : 

niiSmi = (33) 

(34) 

/ 1 \ 

= moi/2 - /9(1 - ml)L + mlpXsoL - + O [j^j (35) 

The fourth term has been simplified in the following way: 



= Z2 + ... (36) 



The expression for X^i'^'^f '^^^ derived above, see equation H21|) . Collecting all the term we obtain the 
following expression for Aq valid at order 0{1): 

Aq = m2 + 2moi/2 - 2/3(1 - ml)L + 2mll3XsGL - ^l^Z^ + rng^sc + ©(l/A^^/") (37) 

2.4 The distribution of the Fields 

The two fields entering the computation are: 

Hi = Y.-^m (38) 

j 

H2 = E^Jo(E^^J""^') (39) 

j i 

Before the reweighting they have a Gaussian distribution with covariances: 



j 

{Hl)iN) = ^^(^X,,™,)'-^E"^^(^')^^™^=^i (41) 
{H,H2)^N) = ^^m,(^X,,m,) = L (42) 



TV 
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After the reweighting the distribution of the fields is proportional to 



p(^+i)(i/i,i72) (X exp[-i(ffi H2)C-' (h')- (43) 



where according to eq. (gUlljlEB and l(l^ : 



C=[ I ] (44) 
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At the end of the computation we expect to find that Ag is proportional to the derivative of the complexity 
with respect to q. 



(45) 



The variation of the self-overlap Aq was computed above, see equation (I37f) . Neglecting the irrelevant 
constant term it can be written as: 



Aq ^ ^ml + 2moH2 with ^ = 1 + 2/31 + 2i3XsgL + Xsg ~ 



1 



The magnetization is univoqucly determined by Hi according to the previously derived relation: 

tanh^^ niQ + BniQ — [3 Hi = 



(46) 



(47) 



Performing the integration over H2 and changing variable from Hi to toq we obtain that the reweighted 
distribution of Hi is proportional to: 



1 



I -ml 



B I exp 



We introduce the new variables: 



(tanh ^ Too + -B^o + 2/9LAgTOo) 
2^^ 



A^-B- 2f3\qL 
A = ^Ag— + 2Zi\^ 



\-ml + 2ZiXlml 



drriQ 



And the reweighted distribution takes the BM form: 



P(^+1)(TO0) 



B exp 



(tanh"^ 



Too — Atoo)^ 



+ ATOo 



(48) 

(49) 
(50) 

(51) 



Where K is the normalization constant. 

A word of caution is in order here. The fluctuations of the field Hi and H2 considered in equations 
(|4()I42(I and described by the distribution function are not fluctuations over the disorder but over the 
different TAP solutions at a given realization of the disorder. In general this leads to the fact that the fields 
before the reweighting are Gaussian but with non-zero means Hu and H2J depending on the disorder, see 
eq. V.25 at pg. 71 in jj. Then the average over the disorder is carried on considering the distribution 
function of Hu and H2J that are again Gaussian with zero-mean but with a covariance matrix that is in 
general different from zero. In the standard case, see eq. V.37 in jjj, the variance is proportional to the 
overlap between different states and analogous relationship can be obtained in our case. However, if we 
assume that different TAP solutions of the same sample are uncorrelated, the disorder variances oi Hu and 
H2J becomes zero, that is we have precisely Hu — and H2J = on each sample. This corresponds in the 
replica language to make a IRSB ansatz with go = 0. If Hu and H2J are zero on each sample, equation 
(I43II can be identified with the distribution over the TAP solutions and over the disorder. Indeed in the 
following we make this identification. This is correct as soon as we want to reproduce the result of the 
annealed computation of the TAP complexity. Instead if we keep non-zero Hu and H2.J we can reproduce 
the so-called replica-symmetric quenched computation of the complexity of BM, see equation (19,20,21) in 
[2]. We recall however that as shown in ^ the annealed computation is correct for what concerns the total 
complexity and one can hope that this simplification holds in other models as well. 



2.5 The Self-Consistency Equations 

The self-consistency equation for the various parameters of the theory are: 



L = 



{mo 



(JV+l) (N+1) 



(52) 
(53) 
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^1 = ((E^io"^'^-i"^'^)') (54) 

i 



IxrX = (Xoo) (56) 

The first equation is simply the equation for q in the BM theory. The self-consistency equation for TvX/N 
gives the BM equation for B, indeed recalling the definition of B, equation (|25|l . and the expression of Xqo, 
equation if^ . we obtain 

B = p\l-q)-P{Xo^)^0^{l-q-{{-l-^ + B\ )) (58) 



1 — TOq 



Recalling the expression for X($f'^^\ equation ^ we can evaluate the equation for Xsg'- 

X5G = (Xo'o) + (E(<^'^)') (59) 

Xsg = {P'{t^^+b] ) + {P^{^1-^ + b^ E ^^o^^^ + 0(W) j ) = 



1 — ttIq y \ 1 — rriQ 



-2 



+ )(1 + ^sg) (60) 



Therefore: 



In the case B — Q the expression simplifies to: 



Xsg = (61) 



with 

As in ^ we can compute the object: 



Xsg - — - 1 (62) 



Xp^l-{p\l~miY) (63) 



Xsg - (^o^o) - (64) 



In this way we recover the stability condition > of the BM theory in the B = case as a positivity 
condition over Xsg — (-'^oo)- 

In order to compute the self-consistency equations for the parameter i, Zi and Z2 we need to determine 
the quantity E« "^^^"^i^'^^^ at order 0(1). This can be done starting from the expression of 5mi and 
Xq^^^'' derived above, that is equation H22|) and We don't report the result that turns out to be equal 
to half the derivative of Aq with respect to /iq as it should since x|^^^'' — dmY^'^^ /dho. To proceed in 
the computation it is also useful to notice that according to equation H27I) derivatives with respect to ho 
are equivalent to derivatives with respect to Hi therefore we have: 

\" Y(^+i).r,(^+i' _'^dAq _1 dAq 
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With this equation we can perform integration by parts and do not need the explicit expression of 
X^i ^ier^^'*'^!^^^^- We rewrite the selfconsistency equations for L, Zi and Z2 as: 

-2\ 



4 \\dHi 
1 d/^q ( d 



r ^ o+S ){1+Xsg) (68) 



\ 2 d/iQ \ dmo 1 — mg y \ 1 ~ "^0 

In the last expression we have used the expression for J2i=o(-^oi'^^'' ')'^ previously derived in the computation 
of XsG see equation (1^ . 

2.6 The L Equation 

The Self-consistency equation for the parameter L reads 

To compute this expression we will use integration by parts. In the following we will use the shorthand 
expression for the Gaussian part of the distribution of the fields: 



G[H,,H2]=cxp[--iH, H,)C-' ^ j] (70) 

where C is defined in equation (|44|l . This is essentially the distribution of Hi and H2 before the reweighting. 
We also recall that K is the normalization constant of the reweighted distribution. Integrating by parts we 
have: 

/I d 
mo—G[Hi,H2]—exp[-XgAq]dHidH2 = (71) 
ZAq dtLi 

- ^ (^{Xoo)+K J mo (^G[i7i,i72]) exp[-\gAq]dHidH2^ (72) 
Taking the derivative of dG[Hi, H2]/dHi and making the integration over H2 we obtain 
ofl\ r «2/i ^ n / tanh"^ mo + Btoo + 2/3LAqTOo 

2(jXgL = 13 [I -q) - B - (mo ) (73) 

Recalling the change of variables 

A = -B- 2(i\qL (74) 

we obtain 

A - -y(l -q) + — (motanh^^mo) (75) 

Thus the selfconsistency equation for L gives an equation identical to the one obtained in the BM theory 
extremizing with respect to A, see 

2.7 The Zi equation 

The Self-consistency equation for the parameter Zi reads 



Integrating by parts we have: 

2 



= J (^^G[HuH2]^cxp[-\gAq]dHidH2 + 

+ ^ [ ^^G[HuH2]exp[-\,Aq]dHidH2 (77) 

4Aq J an I 

A simple computation shows that the first term gives the following contribution: 



((tanh ^ mo — Atoo)^) 



(78) 



The second term in (|77|l requires more care. We start recalling the expression for Aq, equation (|37|l . 
neglecting as usual the constant term. As in subsection 12.41 we write it as 

Aq = '^ml + 2moH2 with ^ = 1 + 2pL + 2I3XsgL + Xsg - (79) 
2 2 p 

Instead of considering the derivatives with respect to Hi we consider the derivatives with respect to as 
originally done in equation Ht)5|) : 

d'^Aq d^Aq d (dAqdma\ d ( dmo\ ( dm^V , \ ^^™o ^Qn^ 



dH^ dhg dho \ drrtQ dho J dho \ dho J \ dho J dh^ 

The second term can be simplified using equation H29|) 



'^7^ = -h^l 2 /^1 2+B] {2mo + 2H2)—^ 

driQ \ dniQ 1 — mp / \ 1 — tiiq ) dho 



\ dmo 1 — / V 1 ~ '^o / ""-o 

Recalling the self-consistency equation for Z2, equation (|68() . we have that the average of the second term 
in is simply given by: 

^d^TOp 2Z2 1 

~dhl' ^ ' 13 1 + XsG 

To evaluate the average of the first term in H80(l we must recall the expression of the susceptibility, equation 
(j28|l . and the expression of Xsg, equation (|61|l . we have 



((2mo + 2H2)—^) = --^^-^ (83) 



/ drriQ \ ^ \ Xsg 



(84) 



, a — = a-2-4/3L (85) 

dht, / l + XsG P l + XsG ^ ' 



\\dhaj I l + XsG 
Summing up the two terms and recalling the expression for a, equation (|79|l . we obtain: 

^d^Aq\ Xsg 2^2 1 

Thus equation H77|l reads 



7 ^ ( ((tanh-Sno-Amo)^) ^^ , 1 



Multiplying both sides by 2A^ we obtain: 



.2ry _ 1/^-1 ((tanh ^mo-Amo)2)\ , \ 



^ 1' " ^ — ^ + ^^^^ ~ ' " '^"^^ ^^^^ 
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Now recalling the definition of the variables A and A introduced in subsection l2.4l 



We obtain the equation: 



A^-B- 2(3XqL (88) 
A=-A,|+2ZiA2 (89) 



A, ^ -A + A + B - 1 (l - ((tanh-Vo-A^o)T ) 



This is precisely the equation corresponding to the extremization of the BM action at a fixed value of 
the selfoverlap q reported in the introduction and we have the correct identification between Ag and the 
derivative of 'E{q) with respect to q: 

dE 

dq 

We do not report the explicit expression of the complexity that can be obtained taking into account the 
rescaling of the temperature associated to the process of adding a spin without changing the couplings . 



\ = — (91) 



3 On Supersymmetry 

By constraining the solutions to have a given overlap q or equivalently by weighting the sum over solutions 
with a weight proportional to e~^«'' we break the supersymmetry of the problem. Considering the bell 
shaped curve described by S((?) we see that at the maximum the action is SUSY while for q different from 
the maximum value q* or equivalently for Xq ^ Q the action is not SUSY but the SUSY violation takes a 
very simple form. 

In the following we will see that at any value of Ag it is possible to write some SUSY Ward Identities 
that reduce to the SUSY relations in the limit Ag 0. In this relations the parameter Ag multiplies some 
quantities that diverge in the limit Ag ^ therefore taking carefully this limit we obtain relations that are 
different from those obtained simply putting Ag = in the equations. 

The point ^(g*) corresponding to the maximum of Ti{q) is singular, there is a zero eigenvalue that is 
definitively different from zero a finite Ag and changes sign at Ag = 0. This can be clearly seen because 
this eigenvalue is proportional to the inverse of the physical parameter L that diverges as Ag — > since 
L oc A/Ag. Therefore for each Ag ^ the determinant of the TAP solutions is strictly different from zero 
and we can apply the cavity method considering the continuation of each solution when a new spin is 
added. Notice that the sign of the determinant of the solutions is univoquely defined on the left and on the 
right of q* therefore we can safely remove the modulus of the determinant from the standard computation 
of the complexity and the integral of the macroscopic action will also change sign at q* . 

At finite A'' the only points where solutions can rise or die are on the line Ag = 0, then adding or 
removing spins the solutions move on the curve E(9, /) since their self-overlap q and free energy / change 
with A^ thus leading to the correct behavior of the solutions as e-^^^'^'^\ 

Since the SUSY is broken for Ag 7^ the determinant of the fermionic fluctuation is no longer zero. 
Thus at each Ag 7^ we have a finite prefactor to the exponential contribution, whose expansion in power 
of 1/A^ vanishes at all orders in the limit Ag ^ 0. If one does not consider the Ag ^ limit the vanishing 
of the prefactor at Ag = is a problem since it is not clear if this change the behavior of the complexity. 
One should be able to prove that even if its expansion vanishes at all orders the prefactor is definitively 
different from zero at each finite A^. Notice that this can happen for instance if the prefactor takes the form 
e""^ thus changing the exponential contribution. Instead the fact that the prefactor is always finite at 
Ag 7^ means that the exponential contribution is dominant and allows us to bypass this problem, indeed 
the identification of the total complexity with the BM complexity can be safely obtained considering the 
limit Ag — > of S(Ag) or equivalently the limit q ^ q* oi Y^{q). 

At the macroscopic level the SUSY-like relationships we will obtain are not relationships between 
the macroscopic parameters, instead they are relationships that connect the macroscopic bosonic order 
parameters 6.17. A and A with averages of the fermionic macroscopic variables. In this way they yield 
independently of the cavity method the physical meaning of A and A obtained in the previous section. 
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Indeed the parameter L, Z\ and Zi requires averages over the fermionic variables to be computed and the 
BRST relationship we will derive are equivalent to the definitions H49|l and (|50|l . 

3.1 Microscopic Supersymmetry 

If we consider the sum over solutions of the TAP equations weighting each solutions with a weigh propor- 
tional to er^'i'^ we obtain that the result can be expressed (removing the modulus of the determinant) as 
an integral over the following action: 

5 = 5({V^,V^,m„a;,})-A,^m2 (92) 

i 

Here and in the following section we will adopt the notation of (20j. The first term is invariant under the 
microscopic BRST derivative Dmicro induced by the following transformation ^1 : 

Sm^^eTp, 5i}i^-exi (93) 

D = V^.a,„. - x,d^^ (94) 
The action is no longer invariant but the variation is easily computed from the previous relations: 

DS = -2Xq^miil)i (95) 

i 

As a consequence the average of a BRST derivative is no longer zero but it is given by: 

{DO) = {DSO) = -2X,{J2 m^AO) (96) 

i 

Thus we can obtain Ward identities also at Xq =^ 0, if we put O — miipj we obtain the following relationship: 

- {rriiXj) = (tpjipi) - 2Xq{mi^tpjipkmk) (97) 

k 

If we set Aq = in the previous relation we obtain a standard SUSY relationship, instead it is crucial to 
consider the limit ^ because the term multiplied by Xq diverges in this limit leading to a finite result. 

Let us show that the previous relation follows naturally if we assume that the solutions can be continued. 
In this case we have that: 



Ota 



dm 
'dh 



-e 



->-qqa 



E 7?^""''°° - 2\ E <^^<e-^"^"= (98) 



Recalling the following relationships we can easily see the equivalence between equation H97|) (obtained 
considering the BRST relationship) and equation H98|l (obtained assuming the possibility of continuing the 
TAP solutions): 

^^'^''^ - ~{m,x,) (99) 



(WV'.) = E^^"'''°° (100) 
- 2A,(TO,^V^V;femfe) = -2A, ^ m^X^fcm^e-^'^- (101) 

k a.k 

If we put O = Xiipj in (|96|1 we obtain the generahzation of another weh-known BRST relation to the case 
A, 0: _ 

{x^Xj) = 2Xq{xi ^ tpjtpkmk) (102) 
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On the other hand if we assume that the TAP solutions relevant for the weighted average exp[— Aqgaa] 
can be univoquely continued we have that: 

•'a a ^ ^ a \ k / 

The equivalence between equations H1U2|1 and pU3|) can be proven considering the foUowing equations: 



dhidhj 



J2e-'^'^-^{x,x,) (104) 



^ a \ k / *fe fe 

3.2 The SUSY relationships encode the physical meaning of the parameters 

By summing equation H97|l over i = j we obtain 

- '^{rriiXi) - '^{ipi'ipi) = ~2Xq{^ m^ip^iljkmk) (106) 

i i ik 

Recalling equation p01|) we see that the r.h.s. it is nothing but the parameter —2XqL where L was defined 
in H15|l . On the other hand the l.h.s. of the previous equation can be expressed in term of the macroscopic 
parameters A, B and A, we have that it is equal to 

i i 

Thus equation H106() is equivalent to 

{A + B) = ~2pXg{L) (108) 

Therefore we see that the BRST relationships allow to recover the physical meaning on the parameters 
A, B and A of the standard TAP complexity computation without the cavity method. They relate these 
parameters to the physical parameters L, Zi and Z2 and the relation is precisely the one that is obtained 
within the cavity method indeed the last equation is equivalent to equation H49() that is the definition of A 
within the cavity method. Notice once again the importance of taking the limit Ag — > instead of simply 
setting Ag = 0. Since L is divergent in this limit the r.h.s. of p()8|l remains finite instead if we put it to zero 
we obtain the standard SUSY solution A + _B = 0. In a similar way we can use the SUSY relation p()2|l to 
uncover the physical meaning of the parameter A of the standard complexity computation in terms of the 
physical parameters L, Zi, Z2 and Xsg^ obtaining a relation equivalent to equation H50|l obtained within 
the cavity method. 



3.3 Macroscopic Supersymmetry 

The results of the previous sections can be recovered also considering the macroscopic action obtained 
within the computation of the complexity. This depends on four bosonic and four fermionic parameters 
{r, t, A, g, p, p, /I, /i}. In presence of a forcing term Xqq the action is 

S = So- Xqq (109) 

The first term is invariant under a macroscopic BRST transformation given by: 





2Ae 

/ 




5p = 


/ r t 




Sjl = 







Sp — 







Sq - 


P 




sx = 







Sr = 


-<m~ 


m 


. St = 
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Therefore the variation of the total action H1U9|) is simply given by: 

2A 

eDS ^ -\5q = e—^Ji (111) 

Much as in the previous sections we have that the averages of a BRST derivative satisfies the following 
relation 

{DO) = {DSO) = ~^{-pO) (112) 
Substituting for O and looking at the first two relations in H11U|) we have that 

= M ^ = (113) 

P P 

= p ^ C-^)^-^{-pp) (114) 

As was derived in ^20. the r.h.s. of the previous equation is proportional to the physical parameter L 
while skipping from the variable {r, t, A, q} to the BM variables {A, B, A, q} the r.h.s. is simply (A + B)//3, 
therefore, much as in the previous subsection, we obtain that the BRST relations within the macroscopic 
formalism encode the physical meaning of the parameters A and A obtained within the cavity method. 

4 Discussion 

Within the cavity method we have been able to eventually obtain the physical interpretation of the param- 
eters A and A of the BM theory in terms of physical objects like L, Zi, and Xsg- The extremization 
with respect to q corresponds to the case \q — 0. However in this limit A and A remain finite because the 
corresponding combinations of physical parameters are diverging. In particular we have 

i = ^ ^ m,Xy oc Y (115) 

Therefore L diverges at A^ = 0. As we recalled in the introduction L it is responsible for the behavior of the 
isolated eigenvalue and its divergence causes this eigenvalue to be zero. Thus in the space of the parameters 
(u, Aq), conjugated respectively to the free energy and to the overlap, the extremization corresponds to set 
M = and \q = 0, but the line A, = is a singular line, and we must carefully take the limit. Instead 
the line m = is regular and we can set u = from the beginning as we did here. It would be interesting 
to check if the presence of two fields H\ and Hi, instead of simply one, and the special role played by 
the self-overlap are connected to the fact that the equivalent replica theory requires the two-group ansatz 
121 129L ini El ■ The Formulation of the theory within the cavity method opens the way to applications to 
different models ^ jSl and optimization problems 0(71. The case of the Bethe lattice is currently under 
investigation. 

Within the SUSY framework we have shown that setting Ag ^ we break the SUSY of the problem thus 
removing the problem of the vanishing prefactor of the exponential contribution. However the BM solution 
satisfies some SUSY Ward identities at any Ag and this ensures its physical consistency with respect to the 
problems discussed in the introduction. The correct way of treating the Ag = case is by taking the limit 
\q — > 0, this is different from setting Aq = from the beginning that instead yields the incorrect standard 
SUSY identities. The SUSY Ward identities connect the bosonic order parameters of the theory with the 
fermionic ones. In this way they encode, within the standard computation of the TAP Complexity, the 
physical meaning, obtained through the cavity method, of the bosonic order parameters in terms of the 
physical observables L, Z\, Z^ that are indeed related to averages of the macroscopic fermionic variables. 

Although the results have been obtained within the SK model they can be extended to all models where 
a BM-like solution for the total complexity exists, e.g. the Ising p-spin model POl. In these models there 
is transition from a non-SUSY solution at high free energies to the SUSY solution j^J at low free energies 
|32| . Actually in all known FRSB and IRSB models the complexity at the lower band edge, given by the 
Parisi solution, is SUSY; this could be related to the fact that in some sense the relevant parameter for the 
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non-SUSY complexity is the self-overlap and not the free energy; instead at the lower band edge the free 
energy must be the relevant parameter since we want to recover thermodynamics. 

Let us also notice that it would be interesting to use the information obtained on the behavior of the 
TAP solutions upon changes of the external parameters to gain further insight in the longstanding questions 
of chaos in temperature and magnetic field (see e.g. discussion in ) . 
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